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We generalize a known analytical method for determining the stability of periodic orbits con- 
trolled by time-delay feedback methods when latencies associated with the generation and injection 
of the feedback signal cannot be ignored. We discuss the case of extended time-delay autosynchro- 
nization (ETDAS) and show that nontrivial qualitative features of the domain of control observed 
in experiments can be explained by taking into account the effects of both the unstable eigenmode 
and a single stable eigenmode in the Floquet theory. 



I. INTRODUCTION 



Throughout the last decade the use of time delayed signals for controlling unstable periodic orbits (UPOs) has been 
a field of increasing interest. A method first introduced by Pyragas [J], known as "time-delay autosynchronization" 
(TDAS), calculates the control force from the difference of the current state to the state one period in the past. 
Socolar et al. 2] have shown that this technique can be improved by using states further in the past. This gener- 
alization of TDAS is called "extended time-delay autosynchronisation" (ETDAS). One great advantage of ETDAS 
over conventional feedback controller schemes is that it can be applied to high frequency oscillators. Since it employs 
a direct comparison of continuous signals generated by the system itself the only factors limiting the speed of the 
controller is the bandwidth of the amplifiers and signal propagation times. There is no need to generate a reference 
signal independently. 

Experiments on electronic oscillators have shown that ETDAS can be effective ^J. They also show, however, that 
the latency time associated with signal propagation - the time required to compare the the current signal with its 
time delayed counterpart and inject the feedback into the system - can have important effects. Just ,4ij has shown how 
longer latency times decrease the range of feedback gains over which control is achieved for simple systems controlled 
by TDAS. Here we extend his analytic formalism, which consists of a first-order perturbation theory in the gain, to 
ETDAS and note some novel features of the behavior of the individual Floquet multipliers. We then show how the 
theoryprovides a qualitative explanation of the shape of the domain of control observed in the experiments of Sukow 
et al.g. 



II. SYSTEM EQUATIONS AND PERTURBATION THEORY 



In this section we review the formalism developed by Just, generalizing to the case of ETDAS controllers. We use 
the same notation as Bleich and Socolar |^ for the system equations and feedback signal, and the notation of Just 
for the Floquet theory parameters. 

Consider a A'^-dimensional dynamical system defined by 

x(t)=f(x(t),eo+e(0), (1) 

where x(t) denotes a A'^-dimensional state vector, eo is a parameter that can be modulated to achieve control, and e is 
a feedback signal. Assume that in the absence of control, e{t) — 0, there exists an unstable periodic orbit xo(t) with 
period r. Let ^{t) = n • x(i) be a component of x that can be continuously measured. The ETDAS feedback signal 
can be written in several equivalent forms: 

oo 

e{t) = 7 E - ^' - - - - (fc + 1)^)] 

fe=i 
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C(t - to -il-R)J2 R'^'^^it -U- kr) 



k=l 



= 7 (at " ^0 - at -U- t)) + Re{t - r), (2) 

where 7 (the feedback gam) and R G (—1, 1) are real parameters, and ti is the latency time. The control force vanishes 
if the UPO is stabilized, since ^(t — kr) = ^(t) for all t and any integer k. TDAS corresponds to the special case 
i? = 0. The last form is the basis for simple implementation of ETDAS in experiments. 

In order to determine whether the controlled orbit is stable. Equation is linearized around the UPO. Defining 
y(t) — x(t) — xo(t), we have 



oe 



(3) 

xo(t),e=0 



J(<) ■ y(t) + 7M(t) ■ y(i - U) - (1 - i?) ^ R'^-'yit kr) 



k=l 



where J{t) ~ J(^)lxo(t) c=o denotes the Jacobian matrix of the uncontrolled system, and M(t) = ffj^ (-jj ® n is a 
N X N matrix containing all information about the control force. 

Since 3{t) and M(t) are both periodic with period t, Floquet theory ensures that y{t) can be written as 



N 



m— n— 1 

where Pm\t) is a periodic function with period r: 

p';:Ht)^pl::Ht + r). (5) 

The factorization of the sum into a double sum is done for convenience in the discussions below. In the absence of 
control, i.e. the absence of time delay terms, there are N eigenmodes of the system, indexed by n. When control 
is turned on, each of these gives rise to a countably infinite set of eigenmodes indexed by m. For each set, there is 
one eigenvalue that begins at the original value A^"-* + icj^"^ for 7 = and varies as 7 is increased. The remaining 
members all have eigenvalues that approach either log \ R\/t or —00 as 7 approaches 0. 

Am ' and ilm^ are the real and imaginary parts of the Floquet exponent corresponding to the eigenmode pm ^ (t) . 
Inserting Equation Q into Equation ||3Jl will lead to conditions that must be satisfied by Am and fim "* ■ The system 
is linearly stable if and only if all Am"* that satisfy these conditions are negative. Equations Q and Q yield the 
following equation for each of the modes Pm\t), where we drop the subscript m and superscript n for notational 
convenience: 

1 _ p-(A+iO)T 

(A + ^n)p{t) + m = J{t)p{t) + 7M(0e-(^+*")*' ^ _ ^^^-(A+.n). - ^')- (6) 
This equation is equivalent to 

(A + in)pit; k) + p(<; k) = [J(t) + KM(t) • W(t, -U)] ■ p{t; k), (7) 
where W(t, At) is the propagator defined by p(t; k) = W(t, At) • p{t — At; k) and 

'^-76 l_^g-(A+^0)r- 

Since k is proportional to 7, it can be loosely thought of as a measure of the strength of the control gain. One must 
keep in mind, however, that the value of n is ultimately determined by the solutions for the exponent A + ifl. Note 
also that the Floquet eigenmodes p{t; k) themselves depend on A + ifl through k, making for a nontrivial modification 
of the usual eigenvalue problem. 

An expression taking the effects of control into account can be derived by perturbation theory. Equation (T)) can 
be written as 

(A + tn)p{t; k) = f-j^ + 3{t) + KM{t) ■ W{t, -ti) \ ■ p{t; K){t). (9) 
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We regard — ^ + 3{t) as an operator with known eigenvalues A^"^ = io;^"^ and consider KM.(t) ■ 'W{t,ti) to be a 
perturbation, a technique famihar from quantum mechanics. The effects of the controller on the Floquet exponents 
can be expanded in powers of k as 

A + in = X + iu; + x{U)K. + o{K'^), (10) 

where the coefhcient xi^i) is a complex valued function. Any effects of interactions between the Floquet modes enter 
only at k^. This is why it is convenient to index the modes by n and m for the purposes of first-order perturbation 
theory. 

As mentioned above, Equation has an infinite number of solutions for A and fl which approach log|-R|/r 
01 or minus infinity as the feedback gain 7 goes to zero. This behavior arises from the essential singularity at 
A = log \R\/t and the divergence at A = —00, the latter arising only due to the nonzero latency time. 

Just 4] has shown how the coefficient xi^i) can be calculated. Let u{t) = p{t; k = 0) and v*(i) be the right and 
left Floquet eigenmode in the absence of control, k = Q. Both are periodic with period r, i.e. u(t) = u{t + t) and 
v*(t) —w*{t + T). Now let u.[t) = exp(ici;i)u(t) and v*(i) = exp(-iwf)v*(t). These satisfy the equations 

\u{t)+k{t) = J(t) • u(t) 
\r{t)-^*(t) = r{t)-3{t), (11) 

with the boundary conditons: 

u(t + r) = e*""u(<) 
v*(t + r) = e-*"^v*(0. (12) 

The standard first-order perturbation theory result for the coefficient x(ti) is 

xiU) = e'-*'p(tO, (13) 

where 

Jo ^*{t)u{t)dt 

Now p{ti) depends on ti only through W, and since u{t) is r-periodic, W(t,t; + T)u{t) = W(t, t;)u(t). Therefore, 
p{ti) has to satisfy 

p{ti+T)=e''^^p{ti). (15) 
Inserting Equation (|13|l in Equation (|10|) and neglecting second order terms yields 

1 _ „-(A+in)r 

A + ^n^X + ^. + p{U), (16) 

Following the treatment of Just Q for the R — case, we note that this expression can be simplified in the case of a 
so-called flip orbit, where u> = i:/t. Defining the frequency deviation Af2 = O — tt/t. Equation Ijltill can be rewritten 
as 

A + ^A17 = A + Pit,), e-(^+^^^)*' ^^t^-^,,^. (17) 

Moreover, since all coefficients in Equation Ullfl are real, and for oj — tt/t the boundary conditions of Equation l|12(l 
are invariant under complex conjugation, u(t) and v* {t) can always be chosen to be real valued. From Equation H14|) 
it is then clear that p{ti) is real and from Equation (|15|l we have p{ti) = —p{ti + t). 

We emphasize that u(i), v*(<:), and p{ti) are also real valued in the case of zero torsion, i.e. w = 0. In this case, 
x{ti) = p{ii) and p is r-periodic: p{ti) = p{ti + t). For torsion- free perturbations. Equation H16|l becomes 

1 _ p-(A+in)r 

A + ^n = X + x{U)l e-(^+^")*' . (18) 

Although a nonzero torsion of all unstable eigenmodes is a necessary condition for possible control, Q the case of 
A < and w = might be interesting because an initially stable eigenmode can become unstable when the control 
force is applied and thus limit the domain of control. 




FIG. 1: Real and imaginary part of the Floquet exponent versus g for At = 1. Thick hnes correspond to a latency time ti = 0, 
thin lines to ti = 0.5r for different values of R: (TDAS), 0.15, 0.25. The solid line represents the system's exponent, the 
dashed line represents the exponent created by the control scheme. 



III. FLOQUET EXPONENTS FOR FIXED LATENCY TIME 

To understand the solutions to Equation IjlTI) . it is helpful to first consider their behavior for fixed values of 
g = —p{ti)j. A detailed discussion of the effects of variations of p with t; will be presented in section IV. 

The behavior of the real and imaginary parts of the Floquet exponent in Equation H17|l can be seen in Figure ^ 
In each panel, curves are shown for both ti — (thick lines) and ti = r/2 (thin lines). For g = (no control), the 
real part A is equal to A. For increasing g the value of A decreases, reaching at g = A(l + R)/2, then changing its 
sign; thus the orbit becomes stable. Further increase of g usually leads to a collision with an exponent created by 
the control scheme, forming a complex conjugate pair (see Figure^b), (d), and (f), except for the thick line in (f)). 
After the collision, A then begins to increase (see Figure ^a), (c), and (e), except for the thick line in (e)). For g 
sufficiently large, A becomes positive again and control is lost. 

Note that as g increases from zero, an infinite number of solutions to Equation 1171) emerge from log|i?|/r as 
complex conjugate pairs. Q In order to collide with the single exponent coming from (A + iuj)T, one pair has to 
become real and separate (see Figure ^d)). If this does not happen, a crossing of branches can occur. After the 
crossing, the complex conjugate pair becomes the branch with largest A and thus responsible for the stability of the 
system (see thick lines in Figure ^e) and^f)). 

Figure^illustrates that increasing the latency time ti and/or decreasing R leads to a smaller range of g for successful 
control. In fact, one can compute a maximum latency time tmax for which control can be achieved, which corresponds 
to the case where the collision of the two branches occurs at A = as in the thin line in Figure ^a) . Using the 
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FIG. 2: Schematic behavior of the multiplier n in the complex plane for g > and = in the case ui — n/r. Pictures (a) 
and (b) visualize the case of an initially unstable multiplier of the system, pictures (c) and (d) the case of an initially stable 
one. Point A indicates the uncontrolled multiplier of the system /i — — exp(Ar), point B shows where the created multipliers 
start, point C is the point where control is obtained, and points D and D' are the points where control is lost. The arrows 
indicate the directions in which the multipliers move for increasing g. 



imaginary part of Equation (|17|l to eliminate the factor of g in the real part of that same equation and setting A equal 
to zero, one has to search for nontrivial sohitions for Afi. A condition for the existence of such a solution is 



ti<t. 



T R-l 



2 R+1 



(19) 



This agrees with the result of 4] for R = 0. For larger latency time, control is not possible to first-order in k. 
Equation H19|) shows that negative R decreases the maximum latency time. We therefore focus on i? > from here 
on. 

Another way to visualize the effects of the control scheme is to consider how the Floquet multipliers (as opposed 
to exponents) evolve with varying g. We consider again the case uj = tt/t. The Floquet multipliers are defined by 



(n) 



;(A^L'+*^f^L')'^. Dropping the subscript m and the superscript n, Equation H17|) can be rewritten: 



fi = exp 



At - gr 



11 + R 



(20) 



Stability is achieved if all multipliers satisfy < 1; i.e. the multipliers /i are located inside the unit circle in the 
complex plane. 

Considering the real and imaginary part of Equation H2()|l and numerically following the roots of each equation in 
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FIG. 3: Domain of control in the t;-7 plane for different values for Ar: -0.3, 0.7, 1.5 and p{ti) — —1. Picture (a) shows the 
case of TDAS, R = 0, and picture (b) the case of -R = 0.68. The branches indicate combinations for ti and 7 for which the real 
part of the Floquet exponent A changes sign and thus stability. 



the complex plane (using Mathematica) , we observe topologically different cases depending on the signs of A and g 
in the absence of latency, t; = 0, as illustrated in Figure 12 

• g > 0; A > 0: (Figure El^a) and (b)) As g increases, the largest Floquet multiplier starts outside the unit circle 
at — exp(Ar) on the real axis indicated by point A, moves towards the unit circle, and eventually crosses it. 
Meanwhile an infinite number of complex conjugate pairs spread out from 11 — R indicated by point B one of 
which will determine the stability range. Two scenarios are possible. One possibility is that one pair recombines 
on the real axis and one of the multipliers collides with the system's while the other approaches zero. After 
the collision they form a complex conjugate pair and cross the unit circle again (see Figure |3a)). The other 
possibilitiy is that the created pair becomes the largest multiplier, turns around and crosses the unit circle (see 
Figure |2Ib)). The first case corresponds to the thick lines in Figure ^c) and (d), the second to Figure Q^e) and 

(f)- 

• g > 0; X < 0: (Figure|2Ic) and (d)) Similar to the previous case the largest Floquet multiplier starts at — exp(AT) 
on the real axis, this time inside the unit circle. It moves towards the origin for increasing g and may either 
collide with a multiplier created by the control force as in Figure [2Ic), or continue towards zero while a complex 
conjugate pair becomes the largest multiplier as in Figure[2Id). In both cases all multipliers stay inside the unit 
circle for increasing g; for A < the system is stable for all 5 > 0. 

• g < 0; X > 0: The largest multiplier starts at — exp(AT) on the real axis and goes to —00, thus control is never 
successful. All other multipliers created by the control scheme stay inside the unit circle for decreasing g. 

• g < 0; X < 0: The largest multiplier starts inside the unit circle, crosses it, and goes to —00. More mulitpliers 
created by the control scheme cross the unit circle for further decrease of g. 



IV. SHAPES OF THE DOMAIN OF CONTROL IN THE tj-T PLANE 

For a discussion of the domain of control in the i/-7 plane let us consider first p(t;) — 1. We will show later how 
the coefficient p{ti) scales the domain at every value of the latency time. 

For each A, the lower branch in Figure 13 is the horizontal line 7 = A(l + -R)/2, where there is a fiip instability 
associated with the real exponent originating from A at 7 = 0. The upper branch corresponds to a Hopf bifurcation 
that can arise in two different ways: (1) the relevant complex conjugate pair of exponents originates in a collision 
between the branch associated with A and a real eigenvalue created by the feedback scheme, as in Figure ^a) or (c); 



y 





FIG. 4: Domain of control in the t;-7 plane for i? = in case of p{ti) — A sm{^ti — cj>). Picture (a) shows the case of an 
UPO (Ar = 1) with A = 2.5 for different values of the phase cj>: O.lvr, O.Stt, O.Ott. Picture (b) shows the case of a stable orbit 
(Ar = —0.3) with A — 0.6 for (p: 0, 0.7n. The shaded regions show the domain of stability for (j) = O.Stt and 4> = 0, respectively. 



or (2) the relevant complex conjugate pair originates at log |i?|/T, as in the thick lines in Figure [H^d). It can be seen 
that increasing R and decreasing A increases the domain of control at fixed ti and increases tmax (see Equation l|19|) ). 
The upper and lower curves do not intersect if the system is already stable, i.e. A < 0. 

The actual domain of control is a distortion of Figure 13 owing to the variation of p with ti. The distortion is simple 
to compute, however, since changing the value of p is entirely equivalent to changing 7. Thus the values of 7 on the 
upper and lower curves at a particular value of ti are simply multiplied by — Note that these variations in p 

cannot change the ratio of the upper and lower values of 7. 

For eigenmodes with w = tt/t, the antiperiodicity of p{ti) and the fact that p{ti) is real require that p(ti) has at 
least one root in the interval [0, r]. We assume for convenience a sinusoidal form p{ti) = A sin(^<; — (j)). Figure^ 
shows the domain of control for different values of the phase (f>. In each panel, the shading indicates the stable domain 
for one choice of (p. 

If a root of p{ti) appears before the upper and lower branches intersect, the domain of control will include a region 
with negative feedback gain 7, as shown in Figure ^a). Since the domain of control at fixed ti scales like 
divergences appear at the values of the latency time for which p{ti) vanishes. For A < 0, shown in Figure 2fb), the 
upper and lower branches still do not intersect. 

The case A < can be important because it can reduce the domain of control, as shown in Figure[Sfc) and (d) , when 
the uncontrolled system has exponents Ai > and A2 < 0. Since second order terms are neglected in the perturbation 
theory, the different Floquet modes of the system do not interact with each other, so the effective domain of control 
is just the intersection of the single domains for each exponent. 

Domains similar to those shown in Figure l^c) and (d) have been observed in experiments on high speed diode 
resonator circuits. The analogous figure obtained from experiments is reproduced here as Figure |3Ja) and (b) to 
facilitate comparison. To construct the theoretical figure, parameter values are adjusted to reproduce several features 
of the experimental results. From the experiments, three parameters are known: the weighting parameter R, the 
largest Lyapunov exponent Ai, and, since the instability is a flip, the frequency toi = tt/t. Equation (|19|l for the Ai 
mode then gives an immediate prediction for t„iax, the largest latency time for which control can be achieved. The 
agreement with the experiment is reasonable, especially given that the very narrow tails of the domains may be hard 
to detect in experiments. 

We make the plausible assumption that the second largest Floquet mode is a stable flip, so uj2 — tt/t. In our simple 
model, there are then five parameters that determine the shapes of the domains of control: A2T (the real part of the 
subleading exponent), Ai and A2 (the amplitudes of the variation in pi and P2), and the phases (jfi and (/)2 (which 
determine where pi and p2 vanish). 

To fix these five parameters, we consider the R — 0.68 domain. The phase 0i must lie somewhere between tiir 
and t2'!T in order for the divergence in 1/p and associated sign change in the domain of control to be right. From the 
fact that the onset of divergence is not evident yet at ti, we estimate that (pi is close to t27T and fix it at O.Gtt. From 
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FIG. 5: Domain of control in the f;-7 plane, (a) and (b): Experimental result from a diode resonator circuit investigated by 
Sukow et al. This is a reproduction of Figure 18 from [j]. In this system, the period r was equal to 100 ns. The scale for 
the gain is multiplied by an arbitrary factor, (c) and (d): Domains determined from theory for two Floquet exponents with 
parameters chosen to reproduce as closely as possible the experimental results of (a) and (b). The thick and thin dashed lines 
show the domains corresponding to the two different modes. (See Figure|l]) The shaded regions show the combined domain of 
control. The parameter values are Air = 0.7, A2r = —1.6, ui = tJ2 = tt/t, p\(ti) — 1.3sin(^fi — O.Gvr) and p2(ti) — 1.4sin(^t;). 
The two panels show different values of the control parameter R. The special latency times marked are used to determine the 
parameter values as explained in the text. 



the fact that the boundary of the subleading mode does not appear to cut off the domain near ti — 0, we take the 
divergence of p2 to occur there, requiring (f)2 = or n. The remaining parameters, Ai, A2, and A2T are adjusted to fit 
ti, t2, the latency times (in units of t) corresponding to the limits of the domains, and 'y{t2), the gain at which the 
lower domain of control is cut off at t2. The parameters determined from the R = 0.68 data are used for the R = 
plot as well since p{ti) is determined purely from the uncontrolled system. 

The primary conclusion we draw is that the theory does give qualitative insight into the structure of the stability 
domains. Even with our crude constraints on the form of p(ti), the general shapes of the domains are reproduced 
surprisingly well. As expected, larger R increases the size of the domain of control, especially the part with negative 
7- 

It may appear that by adjusting the full functions pi and p2 one could fit arbitrary shapes of the stability domains, 
and it is true that many types of undulations in the domain boundaries could be fit. Moreover, one can always appeal 
to lack of robustness to noise to explain why very narrow regions of a predicted stability domain would not show up 
in the experimental data. There are, however, some features of the experimental data that cannot be reproduced by 
the theory presented here. In particular, consider the width of the region at negative 7 for R — 0.68. The upper and 
lower boundaries of the right half of this region both represent instabilities in the same mode, the mode associated 
with Al. For a fixed value of ti, then, the ratio of the 7's at these boundaries is independent of p. The substantially 
larger width of the experimental stability domain cannot be obtained by adjusting any of the parameters in our 
theory. Including additional modes or making a different assumption about UJ2 would not help, since the narrowness 
of the theoretical domain is determined by Ai. We therefore conclude that second-order effects are significant in 
the experimental system. These effects may involve interactions between modes associated with different A's or just 
interactions of modes within the set generated by Ai alone. 

Our analysis can also be used to explore the possibilities for qualitatively different domain shapes. An interesting 
example is obtained when (f)2, the phase associated with the subleading mode of the uncontrolled system is taken to 
be O.Itt (and A2 < 0). As shown in Figure IHI this can lead to a situation in which a nonzero latency time is required 
for effective control. 
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FIG. 6: Domain of control for two non-interacting Floquet modes, AiT = 2, A2T = —0.3, and U!i = ui2 = it/t for R = 0.68. 
The parameters (j) and A are chosen as 0i = 0.657r, A\ = 2.5 and 4>2 = 0.1, A2 = —3. The shaded area is the effective domain 
of control. 



V. CONCLUSION 



We have discussed the effects of latency time on a feedback control scheme known as ETDAS. Using Floquet 
theory and carrying out a first-order perturbation theory in the feedback gain, we have shown that nontrivial domain 
shapes can arise in the plane parameterized by feeback gain and latency time. Within the first order theory, we find 
that no control is possible above a maximum latency time determined solely by the Floquet exponent of the most 
unstable mode in the uncontrolled system. We also find that Floquet modes that are stable in the uncontrolled system 
contribute significantly to the overall stability picture, reducing the domain of control substantially. 

The theory accounts well for qualitative features of the stability domains observed in experiments. As expected, 
larger values of the ETDAS parameter R give larger stability domains. Detailed comparison indicates, however, that 
second order effects are experimentally observable. 
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